Chapter 17 

Generating Functions 



Generating Functions are one of the most surprising and useful inventions in Dis- 
crete Math. Roughly speaking, generating functions transform problems about 
sequences into problems about functions. This is great because we've got piles of 
mathematical machinery for manipulating functions. Thanks to generating func- 
tions, we can apply all that machinery to problems about sequences. In this way, 
we can use generating functions to solve all sorts of counting problems. There is a 
huge chunk of mathematics concerning generating functions, so we will only get a 
taste of the subject. 

In this chapter, we'll put sequences in angle brackets to more clearly distinguish 
them from the many other mathematical expressions floating around. 

The ordinary generating function for (g , g\ , 52 , 53 . . . ) is the power series: 

G(x) = g + 9\x + g 2 x 2 + g 3 x 3 H . 

There are a few other kinds of generating functions in common use, but ordinary 
generating functions are enough to illustrate the power of the idea, so we'll stick 
to them. So from now on generating function will mean the ordinary kind. 

A generating function is a "formal" power series in the sense that we usually 
regard x as a placeholder rather than a number. Only in rare cases will we actu- 
ally evaluate a generating function by letting x take a real number value, so we 
generally ignore the issue of convergence. 

Throughout this chapter, we'll indicate the correspondence between a sequence 
and its generating function with a double-sided arrow as follows: 

(5o,.9i,52,53, •• •) < — > 5o + 9ix + g 2 x 2 + g 3 x 3 H 

For example, here are some sequences and their generating functions: 

(0, 0,0,0,...) < — ► + Ox + Ox 2 + Ox 3 H = 

(1,0,0,0,...) < — > 1 + 0x + Ox 2 + Ox 3 H = 1 

(3,2,1,0,...) < — ► 3 + 2x + lx 2 + Ox 3 H = 3 + 2x + x 2 
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The pattern here is simple: the ith term in the sequence (indexing from 0) is the 
coefficient of x l in the generating function. 

Recall that the sum of an infinite geometric series is: 

1 + z + z 2 + z 3 + ■ ■ ■ = — — 
1 - z 

This equation does not hold when \z\ > 1, but as remarked, we don't worry about 
convergence issues. This formula gives closed form generating functions for a 
whole range of sequences. For example: 

1 

(1,1,1,1,...) < > l + X + X 2 +X 3 + ■■■ 

(1,-1,1,-1,...) < > 1 - X + x 2 - X 3 + x 4 

(l,a,a 2 ,a 3 ,...) < — ► 1 + ax + a 2 x 2 + a 3 x 3 + ■ ■ ■ 
(1,0,1,0,1,0,...) < — ► l + x 2 + x 4 + x 6 + ••• 



l-x 
1 

l + x 
1 

1 — ax 
1 

l-x 2 



17.1 Operations on Generating Functions 

The magic of generating functions is that we can carry out all sorts of manipu- 
lations on sequences by performing mathematical operations on their associated 
generating functions. Let's experiment with various operations and characterize 
their effects in terms of sequences. 



17.1.1 Scaling 

Multiplying a generating function by a constant scales every term in the associated 
sequence by the same constant. For example, we noted above that: 

2 I ™4 I 6 



(1,0,1,0,1,0,...) <— > l + x 2 + x 4 + x b + 



l-x 2 

Multiplying the generating function by 2 gives 

" 2 + 2x 2 + 2x 4 + 2x 6 + ■ ■ ■ 



l-x 2 

which generates the sequence: 

(2,0,2,0,2,0,...) 
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Rule 11 (Scaling Rule). If 

(/o,A,A,---) — F(x), 

then 

(c/ , c/i, c/ 2 , ...) < — ► c-F(x). 
The idea behind this rule is that: 

(c/o, c/i, c/ 2 , . . . ) < — ► c/o + c/iz + c/ 2 a; 2 H 

= c • (/o + As + / 2 x 2 + • • • ) 
cF(x) 

17.1.2 Addition 

Adding generating functions corresponds to adding the two sequences term by 
term. For example, adding two of our earlier examples gives: 

( 1, 1, 1, 1, 1, 1, ••• > <— > j^— 

1 — x 

+ ( 1, -1, 1, -1, 1, -1, ...)<- 



1 + x 



(2, 0, 2, 0, 2, 0, ... ) <— + — — 

1 — x 1 + x 

We've now derived two different expressions that both generate the sequence (2, 0,2,0,...). 
They are, of course, equal: 

1 1 (l + x) + (l-x) 2 



1-x 1 + x (l-x)(l + x) 1-x 2 
Rule 12 (Addition Rule). If 

(/o,A,A,---) < — > F(x), and 
(5o,5i,52, •• •) < — ► G(x), 

(/o + 5o, A + 5i, A + 52, • • • ) <— F(a:) + G(x). 
The idea behind this rule is that: 

00 

(fa + 5o, A + 5i, A +52, • • • ) < — ► E^ n + 5 ™) a; " 

n=0 

(00 \ / 00 ^ 

+ E^ n 
n=0 / \n=0 / 

= F(x) + G(x) 
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17.1.3 Right Shifting 

Let's start over again with a simple sequence and its generating function: 

(M,M,..) ~ ^ 
Now let's right-shift the sequence by adding k leading zeros: 

(0,0, ,1,1,1,...) < — ► x k + x k+1 + x k+2 + x k+3 + ■ ■ ■ 



k zeroes 



X ■ (1 + X + X + X -\ ) 

X k 



1 - X 



Evidently, adding k leading zeros to the sequence corresponds to multiplying the 
generating function by x k . This holds true in general. 

Rule 13 (Right-Shift Rule). If (/o, /i, / 2 , • • • ) < — > F(x),then: 

{^^QJoJuh,...) x k ■ F(x) 

k zeroes 

The idea behind this rule is that: 

k zeroes 

(0T0^0,/0,/i,/ 2 ,..) <— > frx k + hx k+1 + f 2 x k+2 + ■ ■ ■ 

= x k -(h + hx + f 2 x 2 + hx z + ---) 
= x k ■ F{x) 

17.1.4 Differentiation 

What happens if we take the derivative of a generating function? As an example, 
let's differentiate the now-familiar generating function for an infinite sequence of 
l's. 

4- (l + x + x 2 + x 3 + x 4 + ---) = 4-\V— 
ax ax \ 1 — x 

l + 2a; + 3a; 2 + 4a; 3 + --- = 1 (17.1) 

(1 — x) A 

(1,2,3,4,...) ^- ! 



(l-x) 2 

We found a generating function for the sequence (1 , 2, 3, 4, . . . ) of positive integers! 

In general, differentiating a generating function has two effects on the corre- 
sponding sequence: each term is multiplied by its index and the entire sequence is 
shifted left one place. 
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Rule 14 (Derivative Rule). If 

(/ ,/l,/2,/3,...) — F(x), 

then 

(/l, 2/ 2 ,3/3,...) «— » F'(a:). 
The idea behind this rule is that: 

(/i,2/ 2 , 3/ 3 , ...)«—> /i + 2/ 2 x + 3/ 3 x 2 + ■ ■ • 

= ~ (/0 + /l^ + /2X 2 + / 3 X 3 + ---) 

as 

= — F(x) 
dx 

The Derivative Rule is very useful. In fact, there is frequent, independent need 
for each of differentiation's two effects, multiplying terms by their index and left- 
shifting one place. Typically, we want just one effect and must somehow cancel out 
the other. For example, let's try to find the generating function for the sequence of 
squares, (0, 1, 4, 9, 16, ... ). If we could start with the sequence (1,1,1,1,...) and 
multiply each term by its index two times, then we'd have the desired result: 

(0 • 0, 1 • 1, 2 • 2, 3 • 3, ...) = (0,1,4,9,...) 

A challenge is that differentiation not only multiplies each term by its index, but 
also shifts the whole sequence left one place. However, the Right-Shift Rule 13 tells 
how to cancel out this unwanted left-shift: multiply the generating function by x. 

Our procedure, therefore, is to begin with the generating function for (1,1,1,1,.. 
differentiate, multiply by x, and then differentiate and multiply by x once more. 



(1,1,1,1, 
(1,2,3,4, 

(0,1,2,3, 

(1,4,9,16, 

(0,1,4,9, 



1 



1 - x 

d 1 1 



dx 1 — x (1 — x)' 
1 x 



(1-x) 2 (1-x) 2 
d x 1 + x 



dx (l-x) 2 (l-x) 3 
1 + x x(l + x) 



(l-x) 3 {l~xf 

Thus, the generating function for squares is: 

x(l + x) 
(l-x) 3 



(17.2) 
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17.1.5 Products 
Rule 15 ( Product Rule). If 

(oo, ai,ci2,...) < — ► A(x), and (b , bi, b 2 , . . . ) < — ► 

(co, c x , c 2 , . . .) < — ► A(a;) • B(aj), 

where 

c n ::= 0o& n + ai&„_i + a 2 b n -2 + 1- a n b . 

To understand this rule, let 

oo 

C(x) ::= A{x) • B(x) = ^c„a; n . 

We can evaluate the product A(x) ■ B(x) by using a table to identify all the 
cross-terms from the product of the sums: 





b x° 


hx 1 


b 2 x 2 


hx 3 


aox 


a b x° 


a^bix 1 


a b 2 x 2 


a b 3 x 3 


CliX 1 


aib^x 1 


Oi&iX 2 


aib 2 x 3 




a 2 x 2 


a 2 b x 2 


a 2 b\x 3 






a 3 x 3 


a 3 b x 3 









Notice that all terms involving the same power of x lie on a /-sloped diagonal. 
Collecting these terms together, we find that the coefficient of x n in the product is 
the sum of all the terms on the (n + l)st diagonal, namely, 

a ob n + Oi6 n _i + a 2 fr„_2 H ho„6 - (17.3) 

This expression (17.3) may be familiar from a signal processing course; the se- 
quence (cq, ci , C2, . . . ) is called the convolution of sequences (oq , ai , a 2 , . . . ) and (bo , b\ , 



17.2 The Fibonacci Sequence 

Sometimes we can find nice generating functions for more complicated sequences. 
For example, here is a generating function for the Fibonacci numbers: 

(0,1,1,2,3,5,8,13,21,...) «— > 

1 — x — x z 
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The Fibonacci numbers may seem like a fairly nasty bunch, but the generating 
function is simple! 

We're going to derive this generating function and then use it to find a closed 
form for the nth Fibonacci number. The techniques we'll use are applicable to a 
large class of recurrence equations. 

17.2.1 Finding a Generating Function 

Let's begin by recalling the definition of the Fibonacci numbers: 

/o=0 
/i = l 

fn = fn-1 + fn-1 (for n > 2) 

We can expand the final clause into an infinite sequence of equations. Thus, the 
Fibonacci numbers are defined by: 

/o=0 
/i=l 

h =/i + fo 

h =h + h 
h =h + h 



Now the overall plan is to define a function F(x) that generates the sequence on 
the left side of the equality symbols, which are the Fibonacci numbers. Then we 
derive a function that generates the sequence on the right side. Finally, we equate 
the two and solve for F(x). Let's try this. First, we define: 

F(x) = f + f\X + f 2 x 2 + f 3 x 3 + f 4 x 4 + --- 

Now we need to derive a generating function for the sequence: 

(0, 1, /i + /o, /2 + /1, /s + / 2 , •••) 

One approach is to break this into a sum of three sequences for which we know 
generating functions and then apply the Addition Rule: 

(0, 1, 0, 0, 0, ... ) < — > x 

( 0, f , A, f 2 , f 3 , ...)<— xF(x) 

+ ( 0, 0, fo, fu h, ■■■ ) ^ x 2 F(x) 

( 0, l + /o, A + / , /2 + /1, h + h, ••• ) ^ x + xF(x)+x 2 F(x) 

This sequence is almost identical to the right sides of the Fibonacci equations. The 
one blemish is that the second term is 1 + fo instead of simply 1. However, this 
amounts to nothing, since fo = anyway. 
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Now if we equate F(x) with the new function x + xF(x) + x 2 F(x), then we're 
implicitly writing down all of the equations that define the Fibonacci numbers in 
one fell swoop: 

F{x) = f + h x+ f 2 x 2 + h x 3 +--- 

ii ii ii ii ii 

x + xF(x)+x 2 F(x) = +(l + f )x + (f 1 + f )x 2 + (f 2 + f 1 )x 3 +--- 

Solving for F(x) gives the generating function for the Fibonacci sequence: 

F(x) = x + xF(x) + x 2 F(x) 

so 



F(x) = - ^ 

1 — x — x A 

Sure enough, this is the simple generating function we claimed at the outset. 

17.2.2 Finding a Closed Form 

Why should one care about the generating function for a sequence? There are sev- 
eral answers, but here is one: if we can find a generating function for a sequence, 
then we can often find a closed form for the nth coefficient — which can be pretty 
useful! For example, a closed form for the coefficient of x n in the power series for 
x/{\ — x — x 2 ) would be an explicit formula for the nth Fibonacci number. 

So our next task is to extract coefficients from a generating function. There are 
several approaches. For a generating function that is a ratio of polynomials, we 
can use the method of partial fractions, which you learned in calculus. Just as the 
terms in a partial fraction expansion are easier to integrate, the coefficients of those 
terms are easy to compute. 

Let's try this approach with the generating function for Fibonacci numbers. 
First, we factor the denominator: 

1 — x — x 2 = (1 — a\x){l — a 2 x) 

whereas = |(1 + \/5) and a 2 = \(l — V&). Next, we find A x and A 2 which satisfy: 

x = M A 2 
1 — x — x 2 1 — cx\X 1 — a 2 x 



We do this by plugging in various values of x to generate linear equations in A\ 
and A 2 . We can then find A\ and A 2 by solving a linear system. This gives: 
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Substituting into the equation above gives the partial fractions expansion of 

F(x): 

x 1/1 1 



1 — X — X 2 y/5 \ 1 — OL\X 1 — OL 2 X 

Each term in the partial fractions expansion has a simple power series given by the 
geometric sum formula: 

= 1 + a.\X + a 2 x 2 + ■ ■ ■ 

1 — aix 

= 1 + a 2 x + a 2 x 2 + ■■■ 



1 — a 2 x 

Substituting in these series gives a power series for the generating function: 

, x 1 / 1 1 

F(x) = 



y/5 \1 — oi\x 1 — a 2 x 
1 



' ((1 + a x x + a\x 2 + •••)- (1 + a 2 x + ot\x 2 + •••)) 



so 



fn 





This formula may be scary and astonishing — it's not even obvious that its 
value is an integer — but it's very useful. For example, it provides (via the re- 
peated squaring method) a much more efficient way to compute Fibonacci num- 
bers than crunching through the recurrence, and it also clearly reveals the expo- 
nential growth of these numbers. 

17.2.3 Problems 
Class Problems 
Problem 17.1. 

The famous mathematician, Fibonacci, has decided to start a rabbit farm to fill up 
his time while he's not making new sequences to torment future college students. 
Fibonacci starts his farm on month zero (being a mathematician), and at the start 
of month one he receives his first pair of rabbits. Each pair of rabbits takes a month 
to mature, and after that breeds to produce one new pair of rabbits each month. 
Fibonacci decides that in order never to run out of rabbits or money, every time a 
batch of new rabbits is born, he'll sell a number of newborn pairs equal to the total 
number of pairs he had three months earlier. Fibonacci is convinced that this way 
he'll never run out of stock. 
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(a) Define the number, r n , of pairs of rabbits Fibonacci has in month n, using a 
recurrence relation. That is, define r n in terms of various where i < n. 

(b) Let R(x) be the generating function for rabbit pairs, 

R(x) ::= r + r\x + r 2 x 2 + ■. 
Express R(x) as a quotient of polynomials. 

(c) Find a partial fraction decomposition of the generating function R(x). 

(d) Finally, use the partial fraction decomposition to come up with a closed form 
expression for the number of pairs of rabbits Fibonacci has on his farm on month 

n. 



Problem 17.2. 

Less well-known than the Towers of Hanoi — but no less fascinating — are the Tow- 
ers of Sheboygan. As in Hanoi, the puzzle in Sheboygan involves 3 posts and n 
disks of different sizes. Initially, all the disks are on post #1: 

JL 1 1 



Post #1 Post #2 Post #3 

The objective is to transfer all n disks to post #2 via a sequence of moves. A 
move consists of removing the top disk from one post and dropping it onto an- 
other post with the restriction that a larger disk can never lie above a smaller disk. 
Furthermore, a local ordinance requires that a disk can be moved only from a post to 
the next post on its right — or from post #3 to post #1. Thus, for example, moving a 
disk directly from post #1 to post #3 is not permitted. 

(a) One procedure that solves the Sheboygan puzzle is defined recursively: to 
move an initial stack of n disks to the next post, move the top stack of n — 1 disks 
to the furthest post by moving it to the next post two times, then move the big, nth 
disk to the next post, and finally move the top stack another two times to land on 
top of the big disk. Let s n be the number of moves that this procedure uses. Write 
a simple linear recurrence for s n . 

(b) Let S(x) be the generating function for the sequence (s , s± , s 2 , . . . ) . Show that 
S(x) is a quotient of polynomials. 
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(c) Give a simple formula for s n . 

(d) A better (indeed optimal, but we won't prove this) procedure to solve the 
Towers of Sheboygan puzzle can be defined in terms of two mutually recursive 
procedures, procedure Pi (n) for moving a stack of n disks 1 pole forward, and 
P 2 (ri) for moving a stack of n disks 2 poles forward. This is trivial for n = 0. For 
n > 0, define: 

Pi(n): Apply P 2 (n — 1) to move the top n — 1 disks two poles forward to the third 
pole. Then move the remaining big disk once to land on the second pole. Then 
apply P 2 (n — 1) again to move the stack of n — 1 disks two poles forward from the 
third pole to land on top of the big disk. 

P 2 (n): Apply P2(n — 1) to move the top n — 1 disks two poles forward to land 
on the third pole. Then move the remaining big disk to the second pole. Then 
apply Pi(n— 1) to move the stack of n — 1 disks one pole forward to land on the 
first pole. Now move the big disk 1 pole forward again to land on the third pole. 
Finally, apply P 2 (n — 1) again to move the stack of n — 1 disks two poles forward 
to land on the big disk. 

Let t n be the number of moves needed to solve the Sheboygan puzzle using proce- 
dure Pi(n). Show that 



for n > 1. 

Hint: Let s n be the number of moves used by procedure P 2 (n). Express each of t 
and s n as linear combinations of t n -\ and s„_i and solve for t n . 

(e) Derive values a, 6, c, a, (3 such that 



Conclude that t n = o(s n ). 

Homework Problems 
Problem 17.3. 

Taking derivatives of generating functions is another useful operation. This is done 
termwise, that is, if 



t n — 2t n -i + 2i„_2 + 3 



(17.4) 



t n = aa n + b(3 n + c. 



F(x) = f + hx + f 2 x 2 + f 3 x 3 + ... 



then 



F'(x) 



h + 2f 2 x + :!/,,./"' + • • • . 



For example, 
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so 

H(x) ::= j- X .„ = + he + 2x 2 + 3x 3 + ■ ■ ■ 

(l — xy 

is the generating function for the sequence of nonegative integers. Therefore 

1 + X - - ~° ~1 2 | a 2 3 i 



(1-z) 3 

so 



H'(x) = 1 + 2 2 x + 3 2 x 2 + 4 2 x 



" ' xH'(x) = + Ix + 2 2 x 2 + 3 2 x 3 + ■■■ + n 2 x n + 



(1-xf 

is the generating function for the nonegative integer squares, 
(a) Prove that for all k € N, the generating function for the nonnegative integer 
fcth powers is a quotient of polynomials in x. That is, for all k e N there are 
polynomials (x) and Sk (x) such that 

KtwH- (17 ' 5) 



Hint: Observe that the derivative of a quotient of polynomials is also a quotient of 
polynomials. It is not necessary work out explicit formulas for and Sk to prove 
this part. 

(b) Conclude that if f(n) is a function on the nonnegative integers defined recur- 
sively in the form 

f{n) = af(n - 1) + bf(n - 2) + cf(n - 3) + p(n)a n 

where the a,b,c,a E C and p is a polynomial with complex coefficients, then the 
generating function for the sequence /(0), /(l), /(2), . . . will be a quotient of poly- 
nomials in x, and hence there is a closed form expression for f(n). 

Hint: Consider 

Rkjax) 
Sk(ax) 



Problem 17.4. 

Generating functions provide an interesting way to count the number of strings of 
matched parentheses. To do this, we'll use the description of these strings given 
in Definition 11.1.2 as the set, GoodCount, of strings of parentheses with a good 
count. Let c„ be the number of strings in GoodCount with exactly n left parenthe- 
ses, and let C(x) be the generating function for these numbers: 



C(x) ::= c + c\x + c 2 x 2 + 
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(a) The wrap of a string, s, is the string, (s), that starts with a left parenthesis 
followed by the characters of s, and then ends with a right parenthesis. Explain 
why the generating function for the wraps of strings with a good count is xC(x). 

Hint: The wrap of a string with good count also has a good count that starts and 
ends with and remains positive everywhere else. 

(b) Explain why, for every string, s, with a good count, there is a unique sequence 
of strings s\,...,Sk that are wraps of strings with good counts and s — si ■ ■ ■ Sfe. 
For example, the string r ::= (())()(()()) € GoodCount equals Sis 2 s 3 where sj = 
(0)) s 2 = (), S3 = (()())/ ^d this is the only way to express rasa sequence of 
wraps of strings with good counts. 

(c) Conclude that 

C = 1 + xC + {xCf + ■■■ + (xC) n + • • • , (17.6) 

so 

and hence 



2x 

Let D(x) ::= 2xC(x). Expressing D as a power series 

D(x) = do + dix + d 2 x 2 + • • • , 

we have 



c= l±4E±. (17 . 8) 



c ri = %. (17.9) 



2 

(d) Use (17.12), (17.13), and the value of c to conclude that 

D(x) = 1 - y/\ - Ax. 

(e) Prove that 

(2n - 3) • (2n - 5) • • ■ 5 ■ 3 • 1 • 2 n 



d n = 



Hint: d n = D^(0)/n\ 
(f ) Conclude that 

1 f2n 
n + 1 V n 
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Exam Problems 
Problem 17.5. 

Define the sequence r ,ri,r 2 , ■ . ■ recursively by the rule that r = r\ = and 

r n = 7r„_i + 4r„_ 2 + (n + 1), 

for n > 2. Express the generating function of this sequence as a quotient of poly- 
nomials or products of polynomials. You do not have to find a closed form for 

17.3 Counting with Generating Functions 

Generating functions are particularly useful for solving counting problems. In par- 
ticular, problems involving choosing items from a set often lead to nice generating 
functions by letting the coefficient of x n be the number of ways to choose n items. 



17.3.1 Choosing Distinct Items from a Set 

The generating function for binomial coefficients follows directly from the Bino- 
mial Theorem: 




Thus, the coefficient of x n in ( 1 + x) k is (*) , the number of ways to choose n dis- 
tinct items from a set of size k. For example, the coefficient of x 2 is the number 
of ways to choose 2 items from a set with k elements. Similarly, the coefficient of 
x k+i j g tne num ber of ways to choose k + 1 items from a size k set, which is zero. 
(Watch out for this reversal of the roles that k and n played in earlier examples; 
we're led to this reversal because we've been using n to refer to the power of x in 
a power series.) 

17.3.2 Building Generating Functions that Count 

Often we can translate the description of a counting problem directly into a gen- 
erating function for the solution. For example, we could figure out that (1 + x) k 
generates the number of ways to select n distinct items from a fc-element set with- 
out resorting to the Binomial Theorem or even fussing with binomial coefficients! 

Here is how. First, consider a single-element set {ai}. The generating function 
for the number of ways to select n elements from this set is simply 1 + x: we have 1 
way to select zero elements, 1 way to select one element, and ways to select more 
than one element. Similarly, the number of ways to select n elements from the set 
{a 2 } is also given by the generating function 1 + x. The fact that the elements differ 
in the two cases is irrelevant. 
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Now here is the main trick: the generating function for choosing elements from a 
union of disjoint sets is the product of the generating functions for choosing from each set. 
We'll justify this in a moment, but let's first look at an example. According to this 
principle, the generating function for the number of ways to select n elements from 
the {a±, a 2 } is: 



(1 + x) ■ (l + x) = (l + x) 2 =l + 2x + x 2 

gen func for gen func for gen func for 

selecting an a\ selecting an a 2 selecting from 

{ai,a 2 } 

Sure enough, for the set {ai, a 2 }, we have 1 way to select zero elements, 2 ways to 
select one element, 1 way to select two elements, and ways to select more than 
two elements. 

Repeated application of this rule gives the generating function for selecting n 
items from a fc-element set {a\, a 2 , . . . , a fe }: 



(l + x) • (l + x) ••• (l + x) = (l + x) 



k 



gen func for gen func for gen func for gen func for 

selecting an a\ selecting an a 2 selecting an a& selecting from 

{ai,a 2 , ...,a fe } 

This is the same generating function that we obtained by using the Binomial Theo- 
rem. But this time around we translated directly from the counting problem to the 
generating function. 

We can extend these ideas to a general principle: 

Rule 16 (Convolution Rule). Let A{x) he the generating function for selecting items 
from set A, and let B(x) be the generating function for selecting items from set B. If A 
and B are disjoint, then the generating function for selecting items from the union A U B 
is the product A(x) ■ B(x). 

This rule is rather ambiguous: what exactly are the rules governing the selec- 
tion of items from a set? Remarkably, the Convolution Rule remains valid under 
many interpretations of selection. For example, we could insist that distinct items 
be selected or we might allow the same item to be picked a limited number of 
times or any number of times. Informally, the only restrictions are that (1) the or- 
der in which items are selected is disregarded and (2) restrictions on the selection 
of items from sets A and B also apply in selecting items from A U B. (Formally, 
there must be a bijection between n-element selections from AU B and ordered 
pairs of selections from A and B containing a total of n elements.) 

To count the number of ways to select n items from A U B, we observe that we 
can select n items by choosing j items from A and n — j items from B, where j is 
any number from to n. This can be done in cijb n -j ways. Summing over all the 
possible values of j gives a total of 

a b n + a\b n -i + a 2 6„_ 2 H h a n b 
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ways to select n items from A U B. By the Product Rule, this is precisely the coeffi- 
cient of x n in the series for A(x)B(x). 



17.3.3 Choosing Items with Repetition 

The first counting problem we considered was the number of ways to select a 
dozen doughnuts when five flavors were available. We can generalize this ques- 
tion as follows: in how many ways can we select n items from a fc-element set if 
we're allowed to pick the same item multiple times? In these terms, the doughnut 
problem asks in how many ways we can select n = 12 doughnuts from the set of 
k = 5 flavors 

{chocolate, lemon-filled, sugar, glazed, plain} 

where, of course, we're allowed to pick several doughnuts of the same flavor. Let's 
approach this question from a generating functions perspective. 

Suppose we make n choices (with repetition allowed) of items from a set con- 
taining a single item. Then there is one way to choose zero items, one way to 
choose one item, one way to choose two items, etc. Thus, the generating function 
for choosing n elements with repetition from a 1-element set is: 

(1,1,1,1,...) < > l + x + x 2 + x 3 + ■■■ 

1 



1 -x 



The Convolution Rule says that the generating function for selecting items from 
a union of disjoint sets is the product of the generating functions for selecting items 
from each set: 



1^3 <L^3 i^-^ ^ — x ^ k 

gen func for gen func for gen func for g en f unc for 

choosing ai's choosing a 2 's choosing a k 's repeated choice from 

{ai,a 2 , . . . ,a fe } 

Therefore, the generating function for choosing items from a fc-element set with 
repetition allowed is 1/(1 — x) k . 

Now the Bookkeeper Rule tells us that the number of ways to choose n items 
with repetition from an k element set is 

n + k-1 

n 

so this is the coefficient of x n in the series expansion of 1/(1 — x) k . 

On the other hand, it's instructive to derive this coefficient algebraically, which 
we can do using Taylor's Theorem: 
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Theorem 17.3.1 (Taylor's Theorem). 



f(x) = /(0) + f'(0)x + 



f"(0) /'"(0) 



x 3 H + 



/(n)( ) 



x n + ■ ■ ■ . 



This theorem says that the nth coefficient of 1 / ( 1 — x) k is equal to its nth deriva- 
tive evaluated at and divided by n!. Computing the nth derivative turns out not 
to be very difficult (Problem 17.7). 

17.3.4 Problems 
Practice Problems 
Problem 17.6. 

You would like to buy a bouquet of flowers. You find an online service that will 
make bouquets of lilies, roses and tulips, subject to the following constraints: 

• there must be at most 3 lilies, 

• there must be an odd number of tulips, 

• there can be any number of roses. 

Example: A bouquet of 3 tulips, 5 roses and no lilies satisfies the constraints. 

Let /„ be the number of possible bouquets with n flowers that fit the service's 
constraints. Express F(x), the generating function corresponding to (/o, /i, fs, ■ • ■ ), 
as a quotient of polynomials (or products of polynomials). You do not need to sim- 
plify this expression. 

Class Problems 
Problem 17.7. 

Let A(x) — Y^?=o a nX n - Then it's easy to check that 



where A^ n ' is the ?ith derivative of A. Use this fact (which you may assume) instead 
of the Convolution Counting Principle, to prove that 



A(")(0) 
n! 




So if we didn't already know the Bookkeeper Rule, we could have proved it 
from this calculation and the Convolution Rule for generating functions. 



402 



CHAPTER 17. GENERATING FUNCTIONS 



Problem 17.8. 

We are interested in generating functions for the number of different ways to com- 
pose a bag of n donuts subject to various restrictions. For each of the restrictions 
in (a)-(e) below, find a closed form for the corresponding generating function. 

(a) All the donuts are chocolate and there are at least 3. 

(b) All the donuts are glazed and there are at most 2. 

(c) All the donuts are coconut and there are exactly 2 or there are none. 

(d) All the donuts are plain and their number is a multiple of 4. 

(e) The donuts must be chocolate, glazed, coconut, or plain and: 

• there must be at least 3 chocolate donuts, and 

• there must be at most 2 glazed, and 

• there must be exactly or 2 coconut, and 

• there must be a multiple of 4 plain. 

(f) Find a closed form for the number of ways to select n donuts subject to the 
constraints of the previous part. 

Problem 17.9. (a) Let 



What is the coefficient of x n in the generating function series for S(x)7 

(b) Explain why S(x) /(l — x) is the generating function for the sums of squares. 
That is, the coefficient of x n in the series for S(x) /(l — x) is J2k=i k 2 - 

(c) Use the previous parts to prove that 



Homework Problems 
Problem 17.10. 

We will use generating functions to determine how many ways there are to use 
pennies, nickels, dimes, quarters, and half-dollars to give n cents change. 

(a) Write the sequence P n for the number of ways to use only pennies to change 
n cents. Write the generating function for that sequence. 

(b) Write the sequence N n for the number of ways to use only nickels to change n 
cents. Write the generating function for that sequence. 



n 



n(n + l)(2n + l) 
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(c) Write the generating function for the number of ways to use only nickels and 
pennies to change n cents. 

(d) Write the generating function for the number of ways to use pennies, nickels, 
dimes, quarters, and half-dollars to give n cents change. 

(e) Explain how to use this function to find out how many ways are there to 
change 50 cents; you do not have to provide the answer or actually carry out the 
process. 

Exam Problems 
Problem 17.11. 

The working days in the next year can be numbered 1, 2, 3, . . ., 300. I'd like to 
avoid as many as possible. 

• On even-numbered days, I'll say I'm sick. 

• On days that are a multiple of 3, I'll say I was stuck in traffic. 

• On days that are a multiple of 5, I'll refuse to come out from under the blan- 
kets. 

In total, how many work days will I avoid in the coming year? 



Problem 17.12. 

Define the sequence ro, r\, r%, . . . recursively by the rule that r = r\ = and 

r n = 7r„_! + 4r„_ 2 + (n + 1), 

for n > 2. Express the generating function of this sequence as a quotient of poly- 
nomials or products of polynomials. You do not have to find a closed form for 



Problem 17.13. 

Find the coefficients of x la y 5 in (19a; + 4y) 15 

17.4 An "Impossible" Counting Problem 

So far everything we've done with generating functions we could have done an- 
other way. But here is an absurd counting problem — really over the top! In how 
many ways can we fill a bag with n fruits subject to the following constraints? 

• The number of apples must be even. 
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• The number of bananas must be a multiple of 5. 

• There can be at most four oranges. 

• There can be at most one pear. 

For example, there are 7 ways to form a bag with 6 fruits: 

Apples 6 4 4 2 2 

Bananas 5 5 

Oranges 2 1 4 3 1 

Pears 10 10 1 

These constraints are so complicated that the problem seems hopeless! But let's 
see what generating functions reveal. 

Let's first construct a generating function for choosing apples. We can choose a 
set of apples in one way, a set of 1 apple in zero ways (since the number of apples 
must be even), a set of 2 apples in one way, a set of 3 apples in zero ways, and so 
forth. So we have: 

A(x) = l + x 2 + x A + x & + ■■■ = — 

1 — x z 

Similarly, the generating function for choosing bananas is: 

B(x) = 1 + x 5 + x 10 + x 15 + ■■■ = — ^ 

1 — x° 

Now, we can choose a set of oranges in one way, a set of 1 orange in one way, 
and so on. However, we can not choose more than four oranges, so we have the 
generating function: 

1 — x 5 

O(x) = 1 + x + x 2 + .x 3 + x 4 = 

1 — X 

Here we're using the geometric sum formula. Finally, we can choose only zero or 
one pear, so we have: 

P(x) = l + x 

The Convolution Rule says that the generating function for choosing from among 
all four kinds of fruit is: 

A{x)B{x)0{x)P{x) = — [ -^— ^r^^(l + x) 
w K ' w w 1 — x 1 — x 1 — X ' 

1 

~ (1 - xf 

= 1 + 2x + 3x 2 + 4x 3 H 

Almost everything cancels! We're left with 1/(1 — x) 2 , which we found a power 
series for earlier: the coefficient of x n is simply n + 1. Thus, the number of ways to 
form a bag of n fruits is just n + 1. This is consistent with the example we worked 
out, since there were 7 different fruit bags containing 6 fruits. Amazing! 
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17.4.1 Problems 
Homework Problems 
Problem 17.14. 

Miss McGillicuddy never goes outside without a collection of pets. In particular: 

• She brings a positive number of songbirds, which always come in pairs. 

• She may or may not bring her alligator, Freddy. 

• She brings at least 2 cats. 

• She brings two or more chihuahuas and labradors leashed together in a line. 

Let P n denote the number of different collections of n pets that can accompany 
her, where we regard chihuahuas and labradors leashed up in different orders as 
different collections, even if there are the same number chihuahuas and labradors 
leashed in the line. 

For example, P 6 = 4 since there are 4 possible collections of 6 pets: 

• 2 songbirds, 2 cats, 2 chihuahuas leashed in line 

• 2 songbirds, 2 cats, 2 labradors leashed in line 

• 2 songbirds, 2 cats, a labrador leashed behind a chihuahua 

• 2 songbirds, 2 cats, a chihuahua leashed behind a labrador 
And P-j = 16 since there are 16 possible collections of 7 pets: 

• 2 songbirds, 3 cats, 2 chihuahuas leashed in line 

• 2 songbirds, 3 cats, 2 labradors leashed in line 

• 2 songbirds, 3 cats, a labrador leashed behind a chihuahua 

• 2 songbirds, 3 cats, a chihuahua leashed behind a labrador 

• 4 collections consisting of 2 songbirds, 2 cats, 1 alligator, and a line of 2 dogs 

• 8 collections consisting of 2 songbirds, 2 cats, and a line of 3 dogs. 

(a) Let 

P(x) ::= Po + Pix + P 2 x 2 + P 3 x 3 + ■■■ 

be the generating function for the number of Miss McGillicuddy's pet collections. 
Verify that 

(b) Find a simple formula for P n . 
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Problem 17.15. 

Generating functions provide an interesting way to count the number of strings of 
matched parentheses. To do this, we'll use the description of these strings given 
in Definition 11.1.2 as the set, GoodCount, of strings of parentheses with a good 
count. Let c„ be the number of strings in GoodCount with exactly n left parenthe- 
ses, and let C(x) be the generating function for these numbers: 



(a) The wrap of a string, s, is the string, (s), that starts with a left parenthesis 
followed by the characters of s, and then ends with a right parenthesis. Explain 
why the generating function for the wraps of strings with a good count is xC (x) . 

Hint: The wrap of a string with good count also has a good count that starts and 
ends with and remains positive everywhere else. 

(b) Explain why, for every string, s, with a good count, there is a unique sequence 
of strings si, . . . , Sf. that are wraps of strings with good counts and s = Si • • • s&. 
For example, the string r ::= (())()(()()) € GoodCount equals S1S2S3 where s\ — 
(0)> 5 2 = ()> s 3 = (()())/ and this is the only way to express rasa sequence of 
wraps of strings with good counts. 

(c) Conclude that 



C(x) ::= c + C\x + C2X 2 + ■ ■ ■ . 



C=l + xC+ (xC) 2 + ■■■ + (xC) n +■■■ 



(17.10) 



so 



C = 



1 



(17.11) 



1-xC 



and hence 



c _ l±VT^4x' 
~ 2x 

Let D(x) ::= 2xC(x). Expressing D as a power series 

D(x) = do + dix + d 2 x 2 + • • • , 



(17.12) 




(17.13) 



D(x) = 1 - VI - 4x. 



(e) Prove that 



(2n - 3) • (2n - 5) • • • 5 • 3 • 1 • 2 



if! 



Hint: d n = D^(0)/n\ 



(f ) Conclude that 
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Exam Problems 
Problem 17.16. 

T-Pain is planning an epic boat trip and he needs to decide what to bring with him. 

• He definitely wants to bring burgers, but they only come in packs of 6. 

• He and his two friends can't decide whether they want to dress formally or 
casually. He'll either bring pairs of flip flops or 3 pairs. 

• He doesn't have very much room in his suitcase for towels, so he can bring 
at most 2. 

• In order for the boat trip to be truly epic, he has to bring at least 1 nautical- 
themed pashmina afghan. 

(a) Let g n be the the number of different ways for T-Pain to bring n items (burgers, 
pairs of flip flops, towels, and /or afghans) on his boat trip. Express the generating 
function G(x) ::= 5" x " as a quotient of polynomials. 

(b) Find a closed formula in n for the number of ways T-Pain can bring exactly n 
items with him. 
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